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Abstract 

> 

f — ' The general self-adjoint elliptic boundary value problems are con- 

sidered in a domain G C with finitely many cylindrical ends. 

The coefficients are stabilizing (as x — > oo, x € G) so slowly that we 
C can only describe some "structure" of solutions far from the origin. 

This problem may be understood as a model of "generalized branch- 
ing waveguide." We introduce a notion of the energy flow through the 
cross-sections of the cylindrical ends and define outgoing and incoming 
"waves." An augmented scattering matrix is introduced. Analyzing 
the spectrum of this matrix one can find the number of linearly inde- 
pendent solutions to the homogeneous problem decreasing at infinity 
with a given rate. We discuss the statement of problem with so-called 
radiation conditions and enumerate self-adjoint extensions of the op- 
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^ I erator of the problem. 

1 Introduction 



In domain G C R n+1 with finitely many cylindrical ends we consider the 
general formally self-adjoint boundary value problem. The coefficients tend 
to limits (as x — > oo, x G G) too slow to allow obtaining an asymptotic of 
solution at infinity. Using the results of the paper [I] (see also [3 Section 
8.5]), one can get some "structure" of solution to the problem: far from the 
origin a solution is represented as a linear combination of some functional 
series plus a remainder. The coefficients in the linear combination remain 
unknown. In this paper we develop an approach, which, in particular, allows 
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to derive expressions for the coefficients in the structure of solution to the 
problem under consideration. 

Let U r + = {(y, t) : y G fT, t > 0}, r = 1, . . . , N, stand for the cylindrical 
ends, where Q r is the cross-section. (The domain G coincides with the union 
n^U- ■ -un+ outside a large ball.) With every cylindrical end we associate 
limit and model problems in the cylinder IF = {(y,t) : y G Q r ,t G R}. 

As the coefficients of limit problem we take the limits of coefficients of 
the original problem as t — > +00, (y,t) G IT+. It is assumed that the limit 
problems are elliptic. Since the operator of the original problem is formally 
self-adjoint, the operators of the limit problems are formally self-adjoint as 
well. As is known (see e.g. |H1 Chapter 5]), one can consider every limit 
problem as a model of "generalized waveguide." This means that a gen- 
eralized notion of the energy flow through the cross-section of the cylinder 
is introduced, the solution to the homogeneous problem is called incoming 
(outgoing) wave if the energy flow associated with the solution is positive 
(negative). The amplitudes of such waves may grow with power or even with 
exponential rate at infinity. 

The operator of the model problem is formally self-adjoint and depends 
on the parameter Tel. The coefficients of the model problem coincide with 
the coefficients of the original problem on the set {(y, t) G P+, t > T + 3} and 
with their limits (as t — > +00, (y,t) G IFJ_) on the set {(y,t) G U r ,t < T}. 
The coefficients of the model problem tend to the coefficients of the limit one 
as T — > +00. Thus a solution to the homogeneous model problem can be ob- 
tained in the form of functional series by the method of successive approxima- 
tions, as the first approximation it is natural to take a wave of the limit prob- 
lem. On the analogy of the limit problem, for the model problem we introduce 
a notion of the energy flow through the cross-section of the cylinder. The 
formula for the energy flow through the cross-section {(y,t) G IF, i = R}, 
R < T, is the same for both (limit and model) problems because the coef- 
ficients of the problems coincide on the set {(y,t) G IF,£ < T}. Moreover, 
it turns out that a wave and the correspondent solution to the homogeneous 
model problem have equal energy flows through the left infinitely distant 
cross-section of IT. This allows to calculate the energy flows of obtained so- 
lutions to the homogeneous model problem and also allows to separate these 
solutions into incoming and outgoing waves (of the model problem) . Due to 
the formally self-adjointness of the model problem operator, the energy flows 
of such waves remain constant along the cylinder. Recall that the coefficients 
of the model problem coincide with the coefficients of original problem on 
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the set {(y,t) e ITJ_,i > T + 3}. Owing to this fact, one can consider the 
domain G as a branching waveguide, where the waves obtained for the model 
problem in IF propagate along the cylindrical end U r + of G, r = 1, . . . , N. 
Using a modification of the scheme suggested in QjJ Theorem 6.2], we get the 
structure of solutions to the problem in G: far from the origin a solution 
is represented as a linear combination of the waves plus a remainder. Some 
waves properties obtained on the previous step allow us to derive the formulas 
for the coefficients in the structure of solution. The results are represented 
in Theorem 13 . 1 Ul and Theorem 13.111 

The remaining part of the paper basically contains corollaries of the the- 
orems I3.1UI and 13.111 We omit the proofs because they almost repeat the 
proofs of the similar assertions in j3J Chapther 5] or in [llj, where it is as- 
sumed that the coefficients are stabilizing with exponential rate. The changes 
in the proofs mainly consist in usage of Theorem 13.101 or Theorem 13.111 in- 
stead of asymptotic representations. In the main text we insert the exact 
references to the needed proofs. 

The operator of the problem acts in weighted spaces. We obtain some 
information about the kernel of the problem (Propositions 14.21 and I4.3|) and 
introduce "scattering matrices." These unitary matrices take into account 
waves growing at infinity. Analyzing the spectrum of this matrix one can find 
the number of linearly independent solutions to the homogeneous problem 
decreasing at infinity with a given rate (cf. Proposition 14. 5|) . We discuss 
the statement of problem with "radiation conditions:" the domain of oper- 
ator contains only functions with prescribed structure at infinity. This is a 
way to choose a solution (with a certain arbitrariness) (cf. Propositions 14.61 
and 14 .7\i . The intrinsic radiation conditions (the solution mainly consists of 
outgoing waves) can be utilized in every case. To verify whether given radia- 
tion conditions can be used, it is required to know the scattering matrix (cf. 
Proposition 14. 8|) . In Section |4~B1 the self-adjoint extensions of operator of the 
problem are found. 

Some of the results proved in our paper were announced earlier in the 
work jl]. 
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2 Statement of the problem and preliminar- 
ies 



2.1 Domain and self-adjoint boundary value problem 

Let G C M n+1 be a domain with smooth boundary dG coinciding, outside a 
large ball, with the union II + U ■ • ■ U 11+ of non-overlapping semicylinders; 
here IT = {{y r ,t r ) : y r G Q r ,t r > 0}, (y r ,t r ) are local coordinates, and the 
cross-section Q r is bounded domain in R n . In the domain G we introduce 
a formally self-adjoint k x fc-matrix £ of differential operators Cij(x,D x ) 
with smooth coefficients, where ord£jj = + Tj, the numbers ri, . . . ,Tfe are 
non-negative integers, and tj + ■ • ■ + T& = m. Consider the boundary value 
problem 



where B is an m x fc-matrix of differential operators. For a given C we find 
a class of boundary conditions such that for an element B of the class the 
self-adjoint Green formula 



holds with some mx fc-matrix Q of differential operators for all u, v G C%°(G). 
It is supposed that B in ()2.1|) is from the mentioned class and the problem 
is elliptic. 

2.2 Boundary conditions and self-adjoint Green for- 
mula 

If necessary changing the enumeration of the rows and columns in jCij(x, D x ), 
we may always arrange that r = n > T2 > ■ • ■ > rfc. In what follows we 
suppose that this has been done. Denote by K s , s — 1, . . . , r, the number of 
values j such that Tj > r — s + 1. Then i^i + • • • + K T = t\ + • ■ • + = m and 
K\ < ■ ■ ■ < K T < k. On the boundary dG we introduce the m x fc-matrix 



C(x,D x )u(x) = f{x) 
B(x,D x )u(x) = g(x) 



xGG, 
x G dG 



(2.1) 



(£it, d) g + (Bu, Qv) dG = (u, Cv) G + (Qu, Bv) dG 



(2.2) 



/ D 1 \ 



(2.3) 
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where the block D s consists of the rows 

(5 hh ,...,5 k , h )D?- T+s -\ h = l,...,K s ; 

here v is the unit outward normal to dG and D u = —idjdv. With C(x, D x ) 
we associate the sesquilinear form 

= £ E E / ^{x)D^ x u j {x)m^)dx. (2.4) 

The Green formula 

a(u, v) = (Cu, v) G + (Afu, Vv) dG (2.5) 

holds for ti,i) G C%°(G) with some m x /c-matrix jV(x, = Z)^ ) || of 

differential operators, oi&N q j + ordPg^ < + Tj — 1; by (■, -)g and (•, -)qg 
we denote the inner products on L 2 {G) and L 2 (dG). 

Remark 2.1. The proof of the Green formula ()2.5|) is standard. Using "local 
maps," we can consider G as the half-space Wt = {x G M. n ,x n < 0} (cf. [3], 

©). Then D„ = D Xn and ^(s, A,) = Em^Em^^^W. 
where D T = D X1 D X2 . . . D Xn _ 1 . Integrating by parts and changing the order 
of summation, we obtain 

k 

v h = E E E { D rD^^(x)D^ Uj , «0 o = «) 

+ EEE E E (^-^a^(a;)^, ^r^)^ 

8=1 i=l j=l \n\<Tj \a\+P<Tj,l3>s 

where m,d£ C%°(G). This implies f|2.5|) . 

Definition 2.2. v4 matrix V = V(x, D x ) is called a Dirichlet system on the 
boundary dG if there exists an m x m-matrix 1Z = TZ(x, D x ) satisfying the 
following conditions. 

(i) V(x, D x ) = TZ(x, D x )V(x, D x ), where V is given in 

(ii) The matrix 1Z consists of K p x K s -blocks ft]p )S ] (p, s = 1, . . . , r). The 
elements of TZ[ PjS ], s < p, are tangential differential operators with smooth 
coefficients on dG of order not higher thanp — s, while the elements oflZhp jS ], 
s > p, are zeros. The 7Z[ PiP ](x) are nondegenerate matrices, | det T^\pjp] (x) | > 
s > for x E dG. 
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If in particular k = 1, then V(x, D x ) is the usual Dirichlet system of order 
r (see 0,0,131). 

Remark 2.3. The operator TZ from Definition ^. "A has an inverse TZ^ 1 , which 
is a matrix of differential operators of the same structure as 7Z. The block 
T^p~ p ]{ x ) °fT^~ l { x i D x ) is the inverse matrix (JZ^^x))' 1 , p — 1, . . . ,r. The 
blocks TZZ s y s < p, of sizes K p x K s can be successively found from the 
relations 

p-i 

n [ P ] s] ^ D *) = n l] P ]( x ) D x ))H^ a] {x, D x ). 

l=s 

The blocks TZZ, 1 ^, s > p, consist of zeros. 
Let 

V{x, D x ) = K{x, D x )V{x, D x ) (2.6) 
be a Dirichlet system on dG. We set 

T(x,D x ) = n-,\x,D x )M{x,D x ), (2.7) 

where lZ~ l (x, D x ) is the formally adjoint differential operator to 'Rr x {x, D x ) 
and J\f(x, D x ) is from the Green formula ([2.5)1 . Introduce m x fc-matrices B 
and Q such that 

(Bgi, . ..,Bq k ) = (T ql ,...,T qk ), {Q gl ,...,Q qk ) = (V ql ,...,V qk ) (2.8) 

for some numbers q, 1 < q < m, while 

(B ql , . . . , B qk ) = (V qU ...,V qk ), (Q ql , . . . , Q qk ) = -(T ffl , . . . , T qk ) (2.9) 

for the remaining rows of B and Q. Therefore, 

(Afu, Vv) dG - (Vu, Mv)q G = (Afu, n~ l Vv) dG - (n- l vu, Mv) dG 

= (Tu, Vv) dG - {Vu, Tv) g = (Bu, Qv) dG - (Qu, Bv) dG . { ' } 

Since £ is formally self-adjoint, the form (|2.4|) is symmetric (i.e. a(u, v) = 
a(v,u)). From (|2.5j) we obtain 

(Cu,v) G + (Afu,Vv) 9G = (u, Cv) G + (Vu,Afv) dG . (2.11) 

Together with ()2.1()j) this leads to the Green formula (|2.2j) . 
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2.3 Limit operators 

Let r, r = 1, . . . , N, be a fixed number. We write the superscript r at C, 
TZ, and other operators if they are written in the coordinates (y, t) inside the 
semi cylinder n + . Let C r = \\CL\\ and let 

C^y,t,D y ,D t ) = Yl W{v,t)D*D]t. (2.12) 

\n\+n<Tj+T h 

We set ipr(y,t) = i(>(t - T) for (y,t) G Tf + , where ^ e C°°(M) is a cutoff 
function such that ip(t) = for t < 1 and ^(t) = 1 for t > 2. 

Definition 2.4. VFe say t/iat £ zs stabilizing in the semicylinder U r + if there 
exist functions of y GO (limit coefficients ) such that 

lim HVt^-I^^-^HO, H+^t. + t,, i, j = 1, . . . , k. 

(2.13) 

Definition 2.5. Le£ J-"(x,D x ) = \\T q j{x ) D x )\\ be an operator given on the 
boundary dG. Write down T q h in the local coordinates (y,t): 

r qj {y, t, Dy, D t ) = f?f(y> t ) D S°l- 

|a|+/3<ord T q j 

We say that T is stabilizing in IT^_ if there exist functions f°- of y G dfl r 
such that 

lim - fff);cr(dsr x k + )|| = o 

for \a\+/3 < ordjFgj and for all values of q and j ; here R+ = {t G K. : t > 0}. 

Since the coefficients of T> r q A do not depend on t, the operator V(x, D x ) 
from ()2.3j) is stabilizing in 11^, . . . , IT^. Assume that £ is stabilizing in W + . 
The stabilization of Af(x, D x ) in IT^_ is guaranteed by ()2.13|) (the coefficients of 
Af r (y, t, D y , D t ) are expressed in terms of i 7 -?; see Remark |2~T|) . Therefore an 
operator B(x, D x ) constructed of the rows of J\f(x, D x ) and T>(x, D x ) is stabi- 
lizing in IT as well; this case K{x, D x ) = I, see (J2~7)|) . (12~7|) and (j2T%j) . Q . In 
the general case we assume the stabilization of 7Z(x, D x ) = \\TZf iq (x, D x ) \\™ q=v 
Then the operator is stabilizing (see Remark I2.3J) . we get the stabiliza- 
tion of the operators V, T, B, and Q. 
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Let the elements L\Ay, D y , D t ) of the limit operator U = \\L^A\ be given 
by the right-hand side of (|2.12|) with replaced by l^ 1 . Likewise, changing 
the coefficients to the limit ones, we define the limit operators iV r , R r , B r 
and etc. The relations P r = R r T> r and T r = (i? r )~ 1 A^ r are fulfilled, where 
(if)" 1 is formally adjoint to (iF) -1 . From and <Q it follows that the 
matrix B r and Q r consist of the rows of P r and T r . The Green formula 

(Uu, v) m + (B r u, Q r v) dm = (it, Uv) w + (Q r u, B r v) dm (2.14) 

is valid in the cylinder IT = fT x R, where u,o£ C£°(II ). We assume that 
the limit problem 

L r {y,D y ,D t )u(y,t) = F{y,t), (y,t) e IT, 
B r (y,D y ,D t )u(y,t) = G(y,t), (y,t)G9n r , l " J 

is elliptic. 

Denote by W^IT) the space with norm ||e 7 -; if'(IT)||, where if^IT) is 
the Sobolev space, e 7 : (y,t) t— > exp(7t), and 7 e R. For I > r we set 



D 7 (n r ) = J]^(n r ), 



(2.16) 



i=l g=l 

with (jq = ordi?^ — r — Tj, cr g < 0. The map 

A r 7 = {L r , B r } : £><(IT) -> ft< (IT) (2.17) 

is continuous. We introduce the operator pencil 

C 3 A ^ 2T(A) = {L r (y, -Dy, A), A)} (2.18) 

in the domain Q r . The spectrum of W is symmetric about the real line and 
consists of normal eigenvalues. Any strip {A G C : | Im A| < h < 00} contains 
at most finitely many points of the spectrum. Denote by A_„o, . . . , A^o with 
u° > all the real eigenvalues of 2t r (if the number of real eigenvalues is 
even, then Ao is absent). We enumerate the nonreal eigenvalues so that 
< Im A^o +1 < Im X v o +2 < . . . and \ v = \- u , where v = u° + 1, u° + 2, . . . . 
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Let {ip^'^, . . . , (ffr" ,j = 1, ■ ■ ■ ,J V '■= dimker W(X U )} be a canonical 
system of Jordan chains of the pencil 2T corresponding to X u , i.e. is 
an eigenvector and ^' J \...,^- 1 ' J) are associated vectors (e.g., see jTHI). 
The functions 

u^\y,t) = exp(i\ v t) £ jM)Vr £ ' j) (y) (2-19) 

e=o l - 

with cr = 0, . . . , Kj v — 1 satisfy the homogeneous problem (j2.15J) . We intro- 
duce the form 

q r (u,v) := (L r u,v) U r + {B r u,Q r v) dW - (u,L r v) U r - {Q r u,B r v) dw . (2.20) 

It is obvious that q r {u,v) = —q r (v,u) and q r (u,u) G iR. The Green formula 
dZH|) extends by continuity to the functions U G V\(W) and V G £>L 7 (IT), 
therefore q r (U, V) = 0. 

Proposition 2.6 (see [3J). (i) Lei \ e C°°(R), = I for t > 2 and 

x(t) = /or £ < 1. One can choose Jordan chains {^J^} to satisfy the 
following conditions: 

q r (xul a ' 3) , xu^' p) ) = iS^Sj^S*.^!-^, \u\ > i/ , > v , (2.21) 

<f (x^ , x< ,p) ) = ±^,AA^-i-,r, M < ^o, M < n>, (2.22) 

<f (x4 CT,i) , x<' p) ) = 0, H < i/o, I A* I > "o, (2-23) 

where the functions Uu are given in \2.19\) . In \2.22\) the sign depends 
on v and j (and cannot be taken arbitrarily). The equality \2.23\) remains 
true for arbitrary choice of Jordan chains and for any superscripts. The 
conditions \2.21)) - do not depend on the choice of x- 

(ii) The map \2.11\j is an isomorphism if and only if the line K. + iy = {A G 
C : Im A = 7} is free of the spectrum of the pencil W . 

Let 7 > 0. Denote by W 7 (IT) the linear span of the functions {uv^ : 
I ImA| < 7}. It is known (see [3 ) that the total algebraic multiplicity of all 
the eigenvalues of the pencil 2T in the strip {A G C : | Im A| < 7 } is even for 
any 7 > 0; we denote the multiplicity by 2M r (= 2MT). There is a basis 

U \1 • • ■ 1 U X/[ri U \ > • • • ; U M r (2.24) 
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in the space W 7 (IT) obeying 

q r (xut,Xut) = Ti5j,h, q r (xuf,X<)=0, j, h = 1, . . . , M\ (2.25) 

(see here x is the cut-off function from Proposition 12.61 One can 

consider the cylinder IF as a generalized waveguide. The space W 7 (n r ) is 
called the space of waves. The quantity iq r (x u iX u ) represents the energy 
flow transferred by the wave u G W 7 (n r ) through the cross-section Q r of 
the cylinder IT. Thus uf, . . . , u\ lr are incoming waves and 
outgoing waves for the problem (|2.15j) . 

The following proposition is a variant of Proposition 3.1.4 and Theorem 
3.2.1 from 0. 

Proposition 2.7. Assume that^j > 0, the UneM.+i'j is free of the spectrum of 
the pencilW, and {F, G} G ^ 7 (n r )n^_ 7 (n r ). Then a solution u G £>__ 7 (IT) 
to the problem \2.1b^) admits the representation 

M r 

u = G>+ + bj(F, G)uj} + v, (2.26) 

3=1 



where the functions form a basis in W 7 (IT*) and satisfy \2.25\) . v is a 
solution to the problem h2.1ty in T> 7 (II r ). The functionals a\, . . . , a^r- and 
bu r are continuous on H l (W) D 7^_ 7 (IT) and 

aj (F, G) = i(F, u+) m + i(G, Q r up dIl r, 
bj{F, G) = -i(F, uj) U r - i{G, Q r uj) dU r, 

where Q r is the same as in the Green formula K2. 5)) . 



3 The structure of solutions to the problem 

(EH) 

3.1 Construction of a model problem in IF 

In this subsection we construct a differential operator {£^, 03^} in IT such 
that the following conditions are satisfied: (i) {£7^ ®t} coincides with {£, B} 
on the set {(y,t) G If : t > T + 3}; (ii) {£^,93^} coincides with {L r ,B r } 
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on the set {(y,t) G if : t < T}; (iii) the norm ||A^;^(n r ) -> 7^(IT)|| of 
the operator 

A r T = {L r ,B r } - {£ r T ,<3 r T } (3.1) 

tends to zero as T — > +00; (iv) for u,v G C£°(n ) and sufficiently large T 
the self-adjoint Green Formula 

(£ r T u, v) w + (<8 r T u, Q r T v) dU r = (u, Z r T v) U r + (£f T u, W T v) dU r (3.2) 

holds with some m x /c-matrix £l r T of differential operators. 

Recall that ipT(y,t) is a cutoff function, ipT(y,t) = ^>(i — T) for (y, i) G 
TT^, where ip G C°°(M), ^(t) = for t < 1 and t/j{t) = 1 for t > 2. Let 
£^ = Z7 — ipT(L r — C)ipTi where the operator i/j t CiIjt is extended from n+ 
to the whole cylinder IT by zero. First we find a Dirichlet system y r T and an 
operator 7^ such that 

(£yti, t>)rr + (Jt m ' ^t^otf = (u, £<T v )n r + (^t"> ^r^arr (3.3) 

for u,v G Cg°(II ). Then we compose 53^ and QJp from the rows of y r T and 
(by analogy with IjEBjl . and derive (Q from Q . 

Denote N^, = iV r - ^ T (iV r - J\f)tp T and =_£> r - ^r(£> r - £>)#t 
(the operators i^tNi^t and ^tD^t are extended to II by zero). It is clear 
that T> r T = T> r and V> T T is the Dirichlet system on <9IT r . Since T> r consists of 
normal derivatives, we have [V r , ip T ] = on <9IT; here [a, b] = ab — ba. Thus, 
substituting ip T u and for w and v in (|2.11|) . we obtain 

(ip T £?p T u, v) n r+(ip T J\fip T u, V r v) dU r ^ ^ 

By the same arguments from 

(L r u, v) U r + (N r u } V r v) dw = (u, L r v) U r + (V r u, N r v) dU r (3.5) 

we get 

(ip T L r ip T u, v) U r+(^ T N r tp T u, T> r v) 9w ^ 
= (u,ipTL r ipTv)n r + {V r u,il) T N r il)Tv)dw- 

Adding (|3.4j) and (|3.5|) and subtracting (|3.6|) . we arrive at the formula 

(£ r T u, v) w + (W T u, V r T v) aw = (u, £ r v) n r + (V r T u, W T v) aU r . (3.7) 



11 



Recall that V = VSD and P r = R r V r . For sufficiently large T we put 
"Xrp = R r + i/jt{T^- — R r )^T- Due to the stabilization of 1Z in IT|_, the matrix 
is a Dirichlet system on dW, and there exists a differential 
operator such that (D^)" 1 ^ = ^(D^) -1 = /; see Remark Q Let 

T T = (Ji^Wj,. We have 

(NtpU, V r T v )gn r ~ iT^T u -, Nrv)dn r 

= ((K^KrU, T T V r T v) dIl r - (% r T V r T u, (D^^W 



Together with ()3.7j) this implies ()3.3|) . Composing the matrices 23^ and £35" 
from the rows of 7 r T and by the same rule as in ()2.8|) and (|2.9j) . we obtain 
the Green formula (|3.2j) . 

By the construction of {£^,23^} the conditions (i), (ii), and (iv) given 
in the beginning of this subsection are satisfied. Due to the stabilization of 
C(x, D x ) and TZ(x, D x ) in n+ we have 



3.2 The structure of solutions to the model problem ( 13.91 ) 

Taking into account (|3.8|) and the invertibility of the limit operator ()2.17|) 
(see Proposition I2.6|) . we get the following assertion. 

Proposition 3.1. Let the operators C(x,D x ) and lZ(x, D x ) stabilize in IF] 
and let the line K + i'y contain no eigenvalues of the pencil 2T. Assume that 
T is sufficiently large. Then the operator 



(T T u, T T v) dw - (T T u, T T v) dU r. 



hm ||A^ ; p;(n r )^^(n r )|| = o 

— »+oo 



(3.8) 




(3.9) 
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We now introduce functions zf, which play the same role for the prob- 



lem ()3.9j) as the waves uf play for the limit problem (|2.15|) . Suppose that 
the assumptions of Proposition 13.11 are fulfilled. We set 



4 = u t 



+ Y,((A%r 1 & r T ) q uf, j = l,...,M r , (3.10) 

9=1 



where the waves {uf : j = 1, . . . , M r } form a basis in W 7 (n r ) obeying 
(FTTty . (Recall that 2M r (= 2M r (j)) is the total algebraic multiplicity of all 
the eigenvalues of the pencil W in the strip {A G C : | ImA| < 7}.) 

Let us discuss the equality ()3.10|) . Note that ?pT-2uf G £>L 7 (n r ) and 
A r T u^ = Al r ipT-2uf with the same cutoff function ipT as in the previous 
section. By virtue of ()3.8|) the norm of operator (^4!L ) -1 Ay : T>L 7 (IT) — > 
U l (IF) is small; (v4^ 7 ) _1 is bounded because the spectrum of W is symmet- 
ric about the real axis, see Proposition l2.6l (ii). The series J2'^Li((A T L^)~ 1 A T T ) g uf 
converges in the norm of £>L 7 (n r ). Consequently, 

zf = uf modPL 7 (n r ). (3.11) 

Proposition 3.2. Let the assumptions of Proposition I3T71 be fulfilled. Then 
the functions 

Z l ' • • • > Z M r i z \ 1 ■ ■ ■ 1 z M r (^-12) 

defined by \S.10i) are linearly independent modulo T> l _^{W) solutions to the 
homogeneous problem hS.ty . 

Proof. It is easy to see that the functions uh'^ forming the linear span 
W 7 (IT) are linearly independent modulo V l _^(IF); see ()2.19|) . Thus the 
elements of the basis uf, . . . , u^r, u^, . . . , u~^ r in W 7 (IT) are linearly inde- 
pendent modulo T> 1 (IF). Together with the relations (|3.11|) this implies the 
linear independence of zf, j = 1, . . . , M r , modulo T> l _^(IF). 

Let us show that zf satisfy the homogeneous problem ([3.9)1 . Consider 
the equation 

{2f T ^ r T }w = A r T uf. (3.13) 

The inclusion A r T uf G HL r (U r ) holds for j = 1, . . . , M r . The line IR — ry is 
free of the spectrum of W (because the spectrum of 2T is symmetric about the 
real line). By Proposition 13. II there exists a unique solution w G T> 1 (IF) to 
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the problem (ETHJ) . Multiplying $Tn§ from left by (A^)' 1 and using (l3~T|) . 

we get 

" C^)- 1 ^ = (A%)- l A r T uf. 

Thanks to ()3.8|) the operator / — {A r )~ x Aj< is invertible. We write (/ — 
(A1 7 ) _1 Ay) _1 as the Neumann series and obtain 



oo 
9=1 



Keeping in mind that {L r , B r }uj = and (|3.1|) . we deduce from ()3.13|) that 
03^}(u> + uf) = 0. It remains to note that zf=w + uf. □ 
Introduce the form 

Pt(u, v) = (£ r T u,v) w + (W T u, £F T v) dTl r ^ 
- (u, £ r T v) w - (0. r T u, *& r T v) dw . 

It is easy to see that p r T {u,v) = for u G PL (IF) and v G P 7 (IF) (indeed, 
for such functions the Green formula (|3.2|) is fulfilled). 

Proposition 3.3. Let the assumptions of Proposition 1X71 be fulfilled. Then 
the functions satisfy the conditions 

p r T (x4,x4) = ^ i5 hJ> Pt{x4>Xz7) = °> h,j=l,...,M r , (3.15) 

where \ e C°°(R), x{t) = I for t > 2 and x{t) = for t < I. The equali- 
ties A3. 15)) do not depend on the choice of x- 

Proof. Since the waves uf satisfy the homogeneous problem (|2.15|) . we have 
q r (u^, uf) = and 

-q r ( X u±,uf) =q r {{l-x)ui,uf), (3.16) 

where q r is from ()2.20j) . Note that operator {L r ,B r } coincide with {£y, 23^} 
on the support of (1 — x) u h ■ This allows us to write ()3.16|) in the form 

-q r (xutuf)=pU(l-X)ut,uf). (3.17) 

Due to (j3.11|) and x u h e £7 (IT) the Green formula f)3.2j) is valid on the pairs 



{u, 


v} = 


{(1 


-x)(4 




{u, 


v} = 


{(1 




-u±),zf - 


{u, 


v} = 


{(1 


-X)Zh' 


zf-uf}. 
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Thus p r T {u, v) = on the same pairs, and 

P r T ((i - x )ut4) = mi - x)4>4)- ( 3 - 18 ) 

Thanks to Proposition 13.21 we have Pr(z^,zf) = 0. Therefore, from (|3.17j) 
and ()3.18|) we get 

Finally we obtain 

Q r (xUh, Xuf) = q r (xUh, uf) = p r T (xZh, zf) = Prix^, X^f)- 

To establish the first equality in (J3.15)) it remains to use (J2.25|) . In a similar 
way one can prove the second equality in (|3.15|) . □ 
The first assertion of the following theorem is a variant of Theorem 6.2 
from pQ; see also [3 Theorem 8.5.7]. 

Theorem 3.4. Assume that the operators £ and 1Z stabilize in IF. Let 7 > 

and let the line M + ry be free of the spectrum of the pencil W . Then for 
sufficiently large T the following assertions hold. 

(i) A solution u G Pf_ 7 (n r ) to the problem \3. 9\) with right-hand side 25} £ 
7^ 7 (IT) n7?/_ 7 (rr) admits the representation 

M r 

u = 'EMS, 25) '4 + <5) zj} + v, (3.19) 

j=i 

where v is a solution to the same problem in T>i 1 {W), the waves Za are defined 
by i'-i.l(J\) . and 2M r is the total algebraic multiplicity of the eigenvalues of the 
pencil W in the strip {A 6 C : | Im | < 7}. 

(ii) The functionals a±, . . . , au r and b\, ... , bM r are continuous on *R} (W) n 
Ti l JW) and 



aj (P) = i(5,4)n f +^,Q^) Wl 
bjtf, 0) = -i(S,zr) n r-i(&,0^z-) an r, " " ' 

where £2^ is the same as in the Green formula \3. ty) . 

Proof, (i) Since the spectrum of 2T is symmetric about the real line, the 
conditions of theorem guaranty that the line M — 27 is free of the spectrum. 
From the second assertion of Proposition 12.61 and (j3.8J) it follows that 

UA^A^v^un^v^wnKi, 

\\(A^A^V^(W-)^V^(W)\\<1. 
15 



Solutions u G T> (J1 T ) and v G V^(U r ) to the problem (|3.9|) satisfy the 
equations 

u = (AL^A^u + (A^r 1 ^, 0}, v = (A^-'A^v + (A;)- 1 ^, <£>}, 

where A^ is from (j3.1|) . Let us solve this equations by the method of succes- 
sive approximations. We set 

u n+1 = {A r _^Y l A J T u n + u , u = (A^)- 1 ^, <5}, 
v n+1 = (Aiy l A r T v n + v , v = (A^-'iS, (5}. 

By Proposition 12.71 we have 

Uq = i + <3)uj} + v . (3.21) 

Let us write the formulas (|2.27|) for aj($, <3) and bj($, <S) in the form 

aj{3, <8) = iq r (v ,u+), bj($, 0) = -iq r (v ,uj), 
where q r is from ()2.20|) . We prove by induction that 



M r n 

u n = v n + i ^ ^((A r _ 7 )~ 1 A^) m {g r (w„_ m ,^ )u 

j=l m=0 



(3.22) 



' 3 

If n = then ipT22|) coincides with (jS2H). We suppose that (j3~2^|) holds for 
n and show that it remains valid for n + 1. From ()3.22|) we get 

{Alj-^un = {A^Y l A r T v n 

Mr " f3 23) 

j=l m=0 

Using Proposition 12.71 we represent {A r )~ l A r T v n in the form 

(Al^)' 1 A r T v n = (A;y l A^ Vn 

MT (3 24) 

+ z^{g r ((A: 7 )- 1 A^„,n;)n;-g'-((A 7 )- 1 A^ n ,n7)u7}. 1 ' ' 

3=1 
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Taking into account (|3.21|) . (|3.24|) and the formulas for u n+ i and v n+ i, we pass 
from (|3.23|) to the equality (|3.22|) with n replaced by n+1. The formula (|3.22|) 
is proved. 

Substituting v n - m = Ylh=a ((^t-) -1 &r) hv Q into ()3.22|) we obtain 



M r n n—m 

U n = V n + E(( A -7) _lA T) m {^(E(K) _lA T)^0,O'« j 
j=l m =0 h=0 



n—m 



(3.25) 



^(E(K)" 1A t)^o,«7) 



h=0 



The series YlhLo^^) 1 Al T ) h vo converges in the norm of V^(JJ r ), moreover, 
{L r ,B r }J2h=o(( A j)~ lA T) h vo e U^W) n^%(n r ). Using the argument 
given after ()3.10jh we justify the passage to the limit in ()3.25|) as n — > oo. As 
a result we get the representation ()3.19|) . where the functions u G £>1 7 (IT) 
and v G r> 7 (IT) satisfy the problem ()3.9|) . and 

oo 

aj {$,<5) = <g r CC((i4;)- 1 A^) h «b ) «+) ) 

oo 

6,(5,©) = -^(^((^r^s^T). 

The assertion (i) is proved. 

Let us establish the formulas (|3.2U|) . Due to Proposition 13.21 we have 

(ff, zf ) n r + (<5, £^zf) dm = P r T (u, zf), (3.26) 

where u is the same as in ()3.19|) . Let x C°°(1R), x{t) = 1 for t > 2 and 
X{t) = for t < 1. From (|3~TT| and (1 - G ^(IT) we obtain (1 - 

x)^ G D l (W). Then the inclusion w G £> 7 (IT) implies (1 — x) z t) = 0- 

Together with (J3.19|) this allows us to write (J3.26|) in the form 

(d,zf)w + (<5,£l r T zf) d nr 

h=l 
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Note that p r T (v,xzf) = as far as v G V\{W) and \zf G Vi^W); 
see (|3.11|) . Finally we have 

M T 
AT 

By applying Proposition 13.31 we complete the proof. □ 
Theorem 13.41 does not allow us to write a structure of u G T> l p{W) with a 

remainder v G 2^ (IT) if /3 ^ —7. Further we correct this trouble. 

Let a„, ^ G Z, be numbers such that every strip a u < ImA < ImA,, is 

free of the spectrum of 2T '. For sufficiently large T we set 

00 

W M = + ^((i^)- 1 ^)^, (3.27) 

where the functions ui are given in ()2.19j) and satisfy the conditions (j2.21|) - 
()2.23|) . Repeating the arguments form the proof of Proposition 13.21 one can 
show that wi a '^ solves the homogenous model problem ()3.9|) . The func- 
tions wf do not depend on the choice of a u ; indeed, {A r a )~ 1 {F, G} = 
(Ap) -1 {F, G} provided that the strip a < ImA < (3 is free of the spectrum 
of the pencil 2T and {F, G} G TZ l a (W) n U l p (W) (see e.g. [3, Proposition 

3.1.4]). From the relations Wv = Uv mod T> 1 (IF) and the formulas 
(|2.19|1 it follows the linear independence of functions wi a '^. 

Lemma 3.5. Let the assumptions of Theorem \3.J\ be fulfilled and let X-m, • • • , Am 
be all eigenvalues ofQl r from the strip —7 < Im A < 7. Then for sufficiently 
large T the relations 

M 

= 5>S? )2 £ + ^f z u), (3-28) 

hold with the coefficients 

4f = iPt(xw^ p \ b£f = -ip r T { X w^\ X z~), (3.29) 
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where \i = —M, . . . , M, p = 1, . . . , J M; and r = 0, . . . , x PM — 1; x G C°°(M), 
x(t) = lfort>2 and xif) = for t < 1. 

Proof. Since w^^ G T> 1 (IF), where 7 > a M > —7, we have x w f* 
V l _ y (IF) and (x- 1)4 T ' P) e # 7 (II r ). We put {£, 0} = -{£ r T , W T } X w^ p) . It 
is clear that {$, (25 } G ft 7 (iT)n7£L 7 (rr) and {£ r T , W T }{l- X )wt' p) = 
By Proposition 13. II and Theorem 13.41 we have 

M 

(1 - X ) W ™ = YW$£ + ~ x<' p) - 
i/=i 

This leads to (|3.28|) . The equalities (|3.29|) are readily apparent from (|3.28|) 
and Proposition 13.31 □ 

Proposition 3.6. Let \ € C°°(R) ; = 1 for t > 2 and x(t) = for 
t < 1 . TTie functions given in \3.2l\j satisfy the following conditions: 

v\ > v , > i/ , (3.30) 
H < Vo, \lA < vo, (3.31) 
v\ < v , \fJ>\ > vq. (3.32) 

In \3. 31]) the sign depends on v and j and coincides with the sign in \2.22]) . 
The conditions \3. 3(J\) - \3. 32\) do not depend on the choice of x- 

Proof. First we prove that Pt(x w v\ X w v^) = if lm(X u + A M ) 7^ 0. 

Let Im(A y + A M ) > 0. In this case one can choose a v and (see ()3.27p ) 
such that a u + a M > 0. Then for the functions u := x w ^ ^^(n 7- ) 
and v := x w ^' P ^ £ ^a^O^ 1 ") t ne Green formula ()3.2|) holds. This implies 

Let us consider the case Im(A v + A M ) < 0. One can choose (3 V and /3 M such 
that /3„ > ImA^ (3^ > Im A M , and p u + ^< 0. Then (l-x)^ CT ' j) G 2^„(ir), 
(1 — x) w m e ^ M (n r ) and for it := (1 — x^i. 0- ^ and v :— (1 — X )w^' p ^ the 
Green formula (|3.2|) holds. This implies — , (1 — x) w m^) = 0- 

Since the Green formula (|3.2j) holds for «,t)G C%°(G) and j^(^ ff!3 '',^ T ^) = 
0, we get 

^((i-xW^.M^) =P5-((i-xX ,i) ,<* ) ) = -Pr(x4 CT ^x< ,p) )- 
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Pt(x^ j) ,X<' p) ) = 0, 



Thus p r T (xwv \ X<' P) ) = if Im(A„ + A M ) ^ 0. 

Let Im(A„ + A M ) = 0. Without loss of generality we can assume that 
ImA„ > 0. Then a M < -ImA„ < 0. We set {F, G} = {L r ,B r }(l - x)wi a ' j) . 
It is clear that {L r , B r }(l - x)wi a ' j) = {£ r T , W T }(1 - x)w { u J) G H l _ a ^W) n 

Tl l a (IF). Write down the asymptotic of the solution (1— x)wu^ G V l _ a (IF) 
to the problem {L r , B r }u = {F, G}. We have 

M J h ^h— 1 

(1 - xH°> j) = E E E 4* ^f'^ mod 2^ (IT), 

h=-M s=l 8=0 

where 2M stands for the total algebraic multiplicity of all eigenvalues of W 
in the strip — a M > ImA > a M ; see e.g. [3J Proposition 3.1.4]. Note that 
cf'fi = 1 because of the inclusion (wl?'^ — u£'^) G 2^ (IT). Therefore, 

-P r Axwl a ' j) , xw^ p) ) = Mil - X )w^\ (1 - xH* ] ) 
m j h *sh-y 

= g r ((i - x)w^\ (l - xH* ] ) = g r (EEE <% ,s) ut' s \ (i - x)<' p) ) 

h=-M s=l (5=0 

M J h x^-l 

h=-M s=l 5=0 

(in the next-to-last equality we used that q r (u,v) = for u G £>L Qfi (IT) and 

f G D^, (IT)). Taking into account the equality cf'^ = 1 and the relations 
flZZP - jfcZfl , we complete the proof. □ 

Theorem 3.7. Assume that £ and 1Z stabilize in IV, . We also suppose that 
(3 > a and the lines R + ia and R + i(3 contain no eigenvalues of the pencil 
2T. Let \ K , . . . , \ M be all eigenvalues of W from the strip a < ImA < (3 
and {5, G lZ a (H r ) D -R^(II r ). T/ien /or sufficiently large T the following 
assertions hold. 

(i) ^4 solution u G £>^(IT) to £/ie model problem \3. 9j) admits the representa- 
tion 

« = EEE *) w »' j) + v ' ( 3 - 33 ) 

1/=^ J=l cr=0 

where v is a solution to the same problem in V l JU r ). 
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ii) The coefficients c?£< <3) in \3. 33\) can be found by the formulas 



(3.34) 



and 



d^\$, <8) = ±i{{$,w^°- hj) )w 

+ ((S^wi^-'-^mr}, \u\ < u . 

The sign in \3. 35)) is the same as in \2.22]) . 

Proof. Let 7 = max{— a,f3}. We again use the cut-off function \ £ C^G), 
X{t) = 1 for t > 2 and x{t) = for t < 1. 

Let us first consider the case 7 = —a. Let t> G £^(iT) satisfy the model 
problem (H2J). We set {F, G} := {£5,, <B^}(1 - x)u e ftL 7 (IT) nT^IT). By 
Theorem 13.41 we have 

—K 

y = J2i a i4 + hzj) + (1 - *>, (3-36) 

where y G Z>L 7 (n r ). Due to the linear independence of and ()3.28|) the 
waves can be expressed in terms of Wu . From ()3.36|) we get 

-K -K J v ttju-l 

u = y + X v = J2^4 + h i*i) + v = E E G ) ^ + v > 

J = l !/=X j = l CT=0 

(3.37) 

where w = (x v + v) ^ ^i(n r ). Since (1 — x)( u ~ v ) £ ^(n r ) and the 
function (1 — x)w|> is in V l p(W) only if 1/ > K, we have di a ' j \F, G) = for 
z/ = M + 1, . . . , — ZT. In the case —a > /3 the representation (|3.33|) is proved. 

Consider the case —a < [3. Then 7 = (3. Applying Theorem 13.41 we get 
the representation 

M 

X u = Y,i a i4 + h z J} + v, y£ ^( nr )' 
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for the solution x u ^ / - 7 (n r ) to the model problem ()3.9|) with right-hand 
side {F, G} := {£5,, <B^}xw G ftL 7 (IT) n ft 7 (IT r ). Therefore, 

M= E E E 4 ctj) (^g)^)+^ 

I/=-Af j = l cr=0 

where w = (y+(l— x)u) G 2>g(n r ). Owing to the inclusion 1>) G £>^(IT), 

we have a£ (F, G) = for z/ = — M, . . . , K — 1. The assertion (i) of the 
theorem is proved. 

Using Proposition 13.61 and the representation ()3.33|) one can prove the 
formulas ()3.34|) and (J3.35J) for the coefficients; see the proof of (|3.20|) in 
Theorem 13.41 □ 



3.3 The structure of solutions to the problem ( 12.11 ) 

Let us define the spaces T>HG) and Ht(G) by the equalities (|2.1fij) with IF 
replaced by G; the space W 1 (G) is endowed with the norm ||e 7 -; H l {G)\\, 
where e 7 is smooth positive function in G such that e y (y r ,t r ) = exp / yt r for 

dj'-i') e ir. 

Assume that the operators C(x, D x ) and lZ(x, D x ) stabilize in . . . , n+ . 
As was shown the stabilization in W + implies (13.8)1 . Thus the operator 

A{ 1 ) = {C 1 B}:Vi l {G)^n^G) (3.38) 

of the problem ()2.1)1 is continuous. 

Proposition 13.11 and the well known results of the local theory of elliptic 
boundary value problems enable one to prove the following proposition in 
the standard way. The proof is omitted. 

Proposition 3.8. Let the operators C(x, D x ) andTZ(x, D x ) stabilize in U 1 ^, . . 
and let the line R + 27 be free of the spectrum of the pencils 21 1 , . . . , %l N . As- 
sume that T is sufficiently large. Then the operator h8. 8ty) of the problem 
\2.1\) is Fredholm. 

Let us introduce the space of waves W 7 (Cr). Suppose that the assumptions 
of Proposition ()3.8|) are fulfilled. We extend the functions X z f 1 J ' = L • • • > M r , 
from the semicylinder 11+ to the domain G by zero and set 

r-l 

vt:= X zf, h = j + J2M p , j = l,...,M r , r = l,...,N; (3.39) 

P =i 
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here zj 1 are defined by (|3.1U|) . the cut-off function \ is the same as in Propo- 
sition l3~31 Let W 7 (G) be the space spanned by functions of the form +v, 
where v is a function in V^(G), and h = 1, . . . , M, M = J2 r=1 M r . It is clear 
that W 7 (G) C £>1 7 (IT). Note that the elements of W 7 (G) do not necessary 
satisfy the homogeneous problem ()2.1|) . 
Denote 

q(u, v) = {Cu, v) G + (Bu, Qv) dG - (u, Cv) G - (Qu, Bv) dG . (3.40) 

The quantity iq(u,u) represents the total energy flow transferred by the 
wave u G W 7 (G) through the infinitely distant cross-sections fl 1 , . . . , Q N of 
the cylindrical ends of the domain G. It is easy to see that iq(u, u) = for 
an exponentially decreasing function u G V l e {G), e > 0. 

Lemma 3.9. Under the circumstances of Proposition^^ the waves Vj, j = 
1, . . . , M, given by \3. 3ty) satisfy the conditions 

q{vi,vf) = Tihj, q(v±,vj) = 0, j,h = l,...,M. (3.41) 

Thus v± , . . . , v^j are incoming waves and i>f, . . . , are outgoing waves for 
the problem \2.1\) . 

Proof. By Proposition 13.31 the conditions (j3.15|) are valid. Due to the 
Green formula ()3.2j) we can replace in (j3.15J) the cut-off function x by a 
cut-off function ( T G C°°(R), ( T {t) = 1 for t > 3T and ( T (t) = for 
t < IT. Recall that the operator {£,£>} coincides with {£^, 23^} on the set 
{(/,f) 6 II : t r > T + 3}; see section 13.11 If and v h are related to 
different semicylinders 11+ and IT + then those supports do not overlap. We 
have 

q(CrVhXTvf) = TiS hd , q(( T VK, frvf) = 0, j,h=l,...,M. 
Owing to the Green formula (|2.5|) the cut-off function (t can be omitted. □ 

Theorem 3.10. Let C(x, D x ) and TZ(x, D x ) stabilize in n + , . . . , 11+ and let 

the line M + 27 be free of the spectrum of the pencils St 1 , ... , 21 . Then for 
a solution u G T>i_ (G) to the problem \2. 1)) with right-hand side {F^G} G 
TZL(G) the inclusion 

M 

u - Ek< + W e ( 3 - 42 ) 
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holds. Here 



aj = iq(u, vf), bj = -iq(u, v j ), j = 1, . . . , M, (3.43) 

the waves vf are defined by \3. 39i) and \3.1(J\) . where T is sufficiently large. 

Proof. Let ( T G C°°(G), Cr(t) = 1 for t > 3T and ( T (t) = for £ < 2T. 
Denote by the cut-off function such that Q, coincides with ( T inside n + and 
vanishes on the remaining part of G. Theorem 13 .41 implies the representations 
of the form (j3.19|) for the solutions CJ^u G X> z _ 7 (n r ) to the problems (|3.9|) with 
the right-hand sides <5 r } := {£ r T , ¥> r T }C T u, r = l,...,N. To prove (HH 
it remains to note that (tX = Ct and (1 — J2r=i Ct) u e ^y(^)- 

The equalities 1)3.43)1 directly follow from (j3.42j) and Lemma [3.91 □ 

Theorem 3.11. Assume that £ andlZ stabilize in W + . We also suppose that 
(3 > a and the lines R + ia and R + if3 contain no eigenvalues of the pencil 
W. Let Xk, ■ ■ ■ , Am be all eigenvalues of W from the strip a < ImA < (3 
and let r}{$, (55} G 1ZJG), where r\ G C 00 (G) ; suppr/ G II + and r\ = 1 on 
the set {(y,t) G > 3}. If u is a solution to the problem \2.1\) such that 
r)u G T> l a (G) then inside U r + the representation 

v=K j=l cr=0 

holds, where rjv G T>\{G) and 

cjr*»")(ff, 0) = iq(u, qw^"-*- 1 ^), \u\ > v , 

c ( J' j) (& <9) = ±iq(u J r ] wl^-°-^ ) ), \u\ < uq. 
The sign in the last formula is the same as in \2.22}) . 

Proof. The assertion follows from the item (i) of Theorem 13 . 71 and Proposi- 
tion EH □ 
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4 Corollaries of Theorems 13.101 and 13.11 

4.1 Index properties, Scattering matrices, An existence 
criterion of exponentially decaying solutions 

Proposition 4.1. Let the assumptions of Theorem \3.11\ be fulfilled. Then 
the indexes of operators A(a) and A{j3) are connected by the relation 



where k is the total algebraic multiplicity of all eigenvalues of the pencils 
St 1 , • • • , % N in the strip {A G C : a < Im A < (3}. 

The assertion of this proposition follows from the structure ()3.44|) of so- 
lution to the problem (j2.1|) : see [SI Section 4.3]. Using Proposition 14.11 and 
the formal self-adjointness of {£, B} one can prove the following proposition; 
see [3J Section 5.1.3]. 

Proposition 4.2. Let the assumptions of Theorem YS.lH be fulfilled. Then 

dimker .A(— 7) — dim ker ^4.(7) = dim coker ^4(7) — dimcoker A(— 7) = M, 

where 2M is the total algebraic multiplicity of all eigenvalues of the pencils 
SI 1 , ... ,21^ in the strip {A G C : | Im A| < 7}. 

The next proposition is a corollary of the formulas (j3.43|) for the coeffi- 
cients in the structure ()3.42|) of solution; see [3J Propositions 5.3.3, 5.3.4]. 

Proposition 4.3. Let the assumptions of Theorem VJ.llA be fulfilled. Then 
there exist bases Zi, . . . , Zm and X\, . . . , Xm in the space ker ,A(— 7) modulo 
V e W(G) such that 



where the scattering matrices T = and & = \\&kj\\ of sizes M x M are 

unitary, i.e. X* = X -1 and &* = moreover, & = X -1 . 



Ind A(a) -Ind A((3) 




(4.1) 




(4.2) 
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Before formulating an existence criterion of exponentially decaying solu- 
tions to the homogeneous problem (|2.1|) we need to construct a special basis 
{vj}j£ 1 modulo V l JG) in the space of waves Wp(G), (3 > j. 

Lemma 4.4. Let < 7 < (3, and let {Vj}^=\ be a basis in the space of 
waves W 7 (G) modulo V\{G) subjected to 0J1\> . The set {vf}f = 1 can be 
supplemented to a basis {v^}Y=i ^ n Wp{G) modulo T> l JG) so that +v~ £ 
V\W{G) for s = M + 1, . . . ,M' and the relations (ETUI) hold for h,j = 
1,...,M'. 

Proof. In fact the waves vf, s — M + 1, . . . , M' can be constructed in the 
same way as the waves uf (see e.g. [H]), one has to use the functions (j3.27|) 
instead of functions (j2.19|) . 

For simplicity of description we suppose that domain G has only one 
cylindrical end 11^. Assume that the Jordan chains of the pencil 21 1 are 
chosen such that the conditions (j2.21|) - ()2.23|) for the functions f)2. 19j) are 
valid. To the every Jordan chain . . . , (fv" } there correspond 

the functions w^'^\ . . . , w^" given by ()3.27|) . By Proposition 13.61 the 
conditions ()3.30|) - (j3.32|) are valid. With every eigenvalue X u of 21 1 such that 
7 < Im \ u < (3 we associate the functions 

wlf = T'l\{w^ =F ^r°~ X >\ J = 1, • • • , Ju, r = 0, 1, . . . , K jv - 1, 

(4.3) 

where J u = dimker 2l 1 (A i/ ), x is the same as in (|3.39|) . Then owing to (|3.30j) 
and ()3.32|) we have Pt( w %± \ w *u±) = Ti5u, fJ ,o~cr,TO~j,p', the wave w^!± is in- 
coming and the wave u>£_ is outgoing. Due to the linear independence 
of the functions vji^ and Lemma 13.51 the elements of the basis {v^ z }jL 1 

can be expressed in terms of functions x w ^'^ corresponding to the eigen- 
values of 21 1 in the strip {A G C : |ImA| < 7}. Together with ()3.32|) 
this implies p^(w^£\vf) = for s = 1,...,M. It remains to note that 
w ( °f + w { J;i ] = 2 X wl a ' j) G V\(G). As vf, j = M + 1, . . . , M', we can take 
the waves w„£\ □ 

Proposition 4.5. Let < 7 < (3, and let the lines R + i'j and R + i/3 be 
free of the spectrum of the pencils St 1 , . . . ,%L N . Denote by & = &((3) the 
scattering matrix corresponding to the basis {vf}^L x from Lemma \^~l\ Then 

dim ker .4.(7) — dimker^4(/5) = dimker((5 2,2 — /), 
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where 6 2 ' 2 is (M' - M) x (M' - M) -block of the M' x M' -matrix G 
11^(7') \\k,e=i,2- 

The proof is similar to the proof of Theorem 3.3 from [TT] . 



4.2 Problem with radiation conditions 

As before we suppose that C(x, D x ) and lZ(x, D x ) are stabilizing in . . . , 11+ 
and the line R + ry is free of the spectrum of the pencils St 1 , ... , 21^. Denote 
by W out (G) the linear span of the outgoing waves v^, . . . ,vj 4 and consider 
the restriction A of 7) to the space D out (G) = Wout(G)[+]V l (G), where 
by [+] we denote the orthogonal with respect to the form ()3.4U|) direct sum. 
The mapping A : 2} out (G) — > IZ^G) is continuous. 

Proposition 4.6. Let zi,...,Zd be a basis of ker Ai'y) , and let {f,g} G 
Kl r (G),(f,z j ) G +(g,Qz j )eG = 0,j = l,...,d. 

(i) There exists a unique up to an arbitrary element of ker ^.(7) solution 
u G ^out(G) to the problem \2.1)) . 

(ii) The inclusion 

v = u — Mr ~ b 2 v 2 - • • • - o m Vm e T)^W(G) 
holds with the coefficients 

b 3 = XA G - i{g, QX^aa, j = 1, . . . , M, 

where X ll . . . ,X M are elements of ker A(— 7) subjected to \4-.2j) . 

(iii) The solution u satisfies the inequality 



(4.4) 



||v;2^^(G)|| + |6i| + |6 2 | + ... + |6 Af | 

^CdW^y^WiGn + We^LiiGn). 

4. The solution u subjected to the additional conditions (u, zj)g = 0, 
j = 1, . . . , d, is unique and satisfies the estimate (|4.4|) with the right-hand 
side replaced by ||{/,^};^W(G)||. 

This proposition justifies the statement of the problem (|2.1|) with intrin- 
sic radiation conditions (only outgoing "waves" occur in asymptotic formulas 
for solutions). Up to obvious changes the proof repeats the proof of Theorem 
5.3.5 from The next two propositions describe the statement of the prob- 
lem with other radiation conditions. For the proofs we refer to [HI Theorems 
5.5.5, 5.5.6]. 
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Proposition 4.7. Let 771,...,% ^ e a basis 0/ ker .4(7), and let the right- 
hand side {f,g} G TZ l W{G) satisfy the orthogonality conditions (f,T]j)a + 
(#> QVj)dG — 0, j = 1, . . . , d. We assume that for the space ker A(— 7) one 
can choose a basis V\, . . . , Vm modulo T> l W{G) that compatible with the basis 
«i, . . . , U2M for the quotient space W 7 (G) /V^W (G) in the following sense: 

q(uj,V k ) = -iS k j, k,j = l,...,M. (4.5) 

Then the following assertions hold. 

1. There exists a unique up to an arbitrary element 0/ ker .4.(7) solution 
u G f)[+]T>^W / (G') to the problem (J2.1j) . where f) is the linear span of the 
functions Mi, ... , Uyi . 

2. The following inclusion holds: 

v = u — hm - b 2 u 2 - ... - b M u M G V l 1 W(G), 

where bj = i(f, Vj) G + i{g, QVj) 9 G, j = 1, • • • , M. 

3. The solution u satisfies the inequality 

4. The solution u subjectd to the additional conditions (u,T]j)a = 0, 
j = 1, . . . , d, is unique and satisfies the estimate (J4.4|) with the right-hand 
side replaced by \\{f,g};TZ^W(G)\\. 

By Proposition 14. 7[ to enumerate all possible radiation conditions is the 
same that to enumerate all the bases u\, . . . ,u 2 m for the quotient space 
W y (G)/T^W(Gf) and bases V U ...,V M modulo V*W(G) for the subspace 
ker A* (—7) compatible in the sense of ()4.5|) . 

Proposition 4.8. Let W 7 (G) be the space of waves and let the waves v^ 1 , 
j = 1, . . . , M, form a basis of the quotient space W 7 (G) /V^W (G) subjected 
to \3-4-l\j - Denote by {Xx, . . . , Xm} a set of solutions to the homogeneous 
problem {£, B}u = satisfying the inclusions f!4.2j) . Then the following 
assertions hold. 

1. If R is arbitrary and S is an invertible operator in C M , then 

M 



V k = Y (S'^mkX, 
m=l 

M / 1V1 s IVl X \ 

M J = Y I S 3™ U m + Y R 3p\ U t + Y & li U i \ ) ' 
m=l ^ p=l ^ i=\ * ' 



m=1 (4.6) 

M , M , M - . 1 
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where j, k = 1, . . . , M, satisfy the condition (|4.5|) . 

2. // a basis Vi, . . . , Vm modulo V^W(G) for the space ker A(— 7) and a 
basis Ux, . . . ,U2M for the quotient space W 7 (G) /T>tW '(G) satisfy ()4.5|) . then 
there exist operators R and S such that the equalities ()4.6|) hold. 



4.3 The extensions of the symmetric operator 

The schemes for the proofs of propositions listed in this section can be found 
in [3J Section 5.5], the changes in the proofs consist in usage of Theorem 13. 101 
instead of asymptotic representations. 

Here we assume that the elliptic system {£, B} is homogeneous. In other 
words, n = r 2 = . . . = r k = t and V l JN(G) := Ui=i W* T {G). With the 
problem (2.1) we associate an operator M. with the domain 

V(M) = {ue T^W(G) : B(x, D x )u{x) =0,i6 dG} 

that acts in the Hilbert space 

k 

L 2 (G;e_ 7 )Ej]r 7 (G) 

i=l 

by the formula 

(M.u)(x) = e 7 (x) 2 £(x, D x )u(x). 
We denote by (•, -)_ 7 the inner product 



e_ 7 (x) u(x)v(x) dx 



a 



in the space L 2 (G; e_ 7 ). 

Proposition 4.9. Suppose that C(x, D x ) and TZ(x, D x ) are stabilizing and 
the line ffi. + i*y is free of the spectrum of the pencils . . . , 21^. Then the 
operator Ai is closed and symmetric. For the coker Ai one can choose a basis 
Xi, . . . ,Xm modulo T> l W(G) such that the inclusions (|4.2j) hold. 

Proposition 4.10. Let C(x, D x ) andTZ(x, D x ) stabilize and let the UneM.+ij 
be free of the spectrum of the pencils . . . , 21^. The operator Ai*, adjoint 
to Ai in the space L 2 (G] e_ 7 ), is defined on the set 

V(M*) = {v e W 7 (G) : B(x,D x )v(x) = 0,x G dG} 

and acts by the formula (Ai*u)(x) = e 7 (a;) 2 £(a;, D x )u(x). 
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We extend the operator M. by adjoining representatives of waves to the 
domain. Let u G T>(A4*). Then u is a solution of the problem (J2.1j) with the 
right-hand side {f,g} = {Cu,0} G L 2 (G;e 7 ). In accordance with proposi- 
tions 14.71 and 14.31 the function u has the form 



where u° is such that u° — &it>f — ... — 6 M t>^ f G T> 7 (G). With every function 
u G V(Ai*) we associate vectors d = (di, . . . , g?m) and b = (&]_,..., 6 M ) of the 
coefficients. 

Proposition 4.11. Suppose that C(x,D x ) and TZ(x,D x ) are stabilizing and 
the line R + 27 is free of the spectrum of the pencils . . . , 21^. Let C M = 
N + (+)No(+)N_ be an orthogonal sum of sub spaces and let K be a self-adjoint 
operator in No. The operator M is a self-adjoint extension of Ai if and only 
ifM is defined on the set 



and acts by the formula (Mm)(i) = e 7 (x) 2 £(x, D x )u(x). 
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